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. FOREWORD 

, Gomprehensive planning has been identified as an essential 
ingredient in the collective efforts of state and local education 
agencies to increase the responsiveness of vocational education. 
This report describes in summary fornix the procedures that were 
used to produce the findings and conclusions that are found in 
three related Nat ional Center reports dealing with aspects of 
comprehensive vocational education planning^ and that were 
produced as a result of two years of research. 

We would like to thank the approximately 500 persons in the 
states of Colorado^ Texas^ Geargia^ Kansas^ Oklahoma^ Wisconsin^ 
West Virginia^ and Florida^ who contributed ^ their time, ' 
^expertise, and knowledge to this effort. 

Special appreciation is extended to Drs. Mary Ellis 
(President, Ellis Associates), Alberto Cardenas (Associate" 
Professor, Pan American University), and James Hale (Associate 
Professor, University of Florida) who provided methodological 
assistance to staff in the conduct of this research. 



Robert E. Taylor 
Executive Director- 
National Center for Research 
in Vocational Education 
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EXECUTIVE SUMMARY 



the local Lv^l 5 vocational education planning at 

II alio i„i!ules a dlscrfpM^- 'oS °f i" Seluon 

vocational education |!anning «ere derived- 'k^'^\" 
established arrangements for\.)^??^Lf^ ? i ""^ "^^^^ 
local level v,^,i.»vi„„ V ^ collecting information about 

in^oJmiuo^^sIf r'^nl^:??^"" P^l^i^g.- ' = ' ^he scope 'of 
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INTRODUCTION 



This document presents an overview of the procedures that 
wpre used tr> produce the findings contained in three related 
reports • These reports are: Coordination in Vocational 
Education: Barriers and Facili tatorg^ ^ Conditions Affecting 
Vocational Education Planning; Implications for Administration 
and Research ;^ and Improving the Technology of Local Level 
Vocational Education Planning . 

The first report resulted from research carried out during 
1979. The two other reports resulted from research carried out 
during 1980. The 1980 research represented an effort to verify 
modify/ and extend the 1979 findings about coordination in 
vocational education planning , and about the process and 
practices of vocational education planning. 



^ Organization of the Report 

The present report consists of two sections in addition to 
the introduction. Section* I presents a brief summary of the 
findings of the study about coordination in vocational education 
planning, and an overview of procedures used to formulate the 
findings. Section II presents a brief summary of the current 
year's findings about conditions affecting vocational education 
planning, and the context and realities of local level planning. 
This section also provides an overview of procedures used to 
formulate tl>ese findings. 



1. Harold Starr, et al . , Coordination in Vcrrational Education 
Planning: Barriers and Facilitators ( Columbus , Oh io : The 
National Center for Research -in Vocational Education, The Ohio 
State University, 1980). * " ' 

2. Harold Starr, et. all. Conditions Affecting Voc:ational 
Education Planning: Implications for Administration anT"Research 
(Columbus, Ohio: The National Center for Research in Vocational 
Education, The Ohio State University, 1981). 

« ''.■■* 
^. Harold Merz, et. al. , Improving the Technology of Local Level 
Vocational Education Planning: (Columbus, Ohio: The National 
Center for Research in Vocational Education, The Ohio State 
University, 1981). 



SECTION I 

COOKinNATlON IN VOCATIONAL RDUCATION PLANNING: 
FUKRIERS AND FACILITATORS ^ 

gjiinglgc y of Findings • 

T^is stuHy Cocuscd on the process of coordination that 
''''''lio^'^ ^" ^ vocational education plan. 4 Such a plan 

repr'-sont.s a negotiation, ^accommodation, and integration of all 
the ^ly^^r^^e interests and concerns of agencies and individuals 
mvoivoa in tne future and direction o5> vocational education. 

Jho establishment of effective coondinative relationships is 
^^^^ntial^^omponent of vocational education planning. This 
study describes numberous way to facilita.te the coordinative 
relationships- Tho examples that were described were found in 
^ ^^li^^^^^'^rH -''''^'' suggested by persons who are currently 
xnvolv^cS in coordination activities in support of vocational 
oducaciQ^ planninq. 

^jj5o identified were barriers to effective coordinative 
relationships. ^^r vocational education planning purposes. The 
-report barriers represent those *.hat seemed to be common across 
'^^f^'^^^ participating in the research effort and that Seemed 
to be most important in impeding effective coordination in 
planning^ 

'in^^ ^^ '^'5!''^'°" and uncertainties about roles and 
responsii^ijities for coordination in support of. statewide 
''?''"^nin-''^^ education planning the compliance orientation toward 
planning, excess specificity m legislation, restrictive fGndina 
burdens Associated with the collection and transmission of SaJa^' 
S'^f^irr^"^ definitions and labeling of special populations, ' 
differences 1" PJ-anmnq cycles and schedoling, differences^ in 
organisational objectives, and the influences of environmental ' 
''r^ai'^''''' ^^-^i^S^^g vocational education planning .were some of 
the ina^or barriers reported by participants that affect 
coordination ir> vocational ^ducatiofi planning at the local level 
at the state level , and be twe^en^TlB^l and stite levels. Thele 
^tV!nlt^ ^"^^^idl effects -upon coordination were described in an 
attempt to provide a better understanding of the current state of 
coordination m vocational education planning. 

^Z^tl c>P^f3tional definitions of coordination and 

rf^^ibS^^ education. Planning used in this study and the study 
descrabj^ cJ^Ji^'' " Coo rdination in Vocational Edno. i-L^ 
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Overview o £ Procedures 



The basic procedures for this research effort included- 
deyelopinq and implomentinq procedures to obtain pertinent 
information about coordination in vocational educatio^ p?annina 
and developing nnd implementinq procedures to analyze and ^' 

dinoauefi^ rh^^^^r^'' ^^^^^^^-^ information obLined from" 
diaioques in the cooperatinq faold site s'tates. 

Selecting Field Site istates " * * 

'criteri^ ^^^^^^ . . ^•^ie^'ted, using six specific selection 
criteria. The six criteria were intended to assure ti>at state*; 
of varyinq characteristics were represented. The six seJction-' 
criteria are described as follows: selection. 

o g^overnance Structure; Addresses the location of the St>ate 
^ZrJT. Education (SDVE) in the education 

administrative system of the state. This criterion wa^ 
concerned With whether the state agency reIponIIb?e fl? 
vocational education is an independent body or Whether it 
IS withm the state department of educatioJi. Further if 
It was in the state department of education, there was 
concern for its relative location within the 
administrative hierarchy. 

o Numbe r and Cha r acteristics of Loc;.l fs .,^^^^^^ 

$2|g£ie£(iifAs2; Reflects the concern for the relative 
number of LEAs in the state, the characteristics of those 
LEAS in ter^s of size, 'whether they were rural or urban? 
and their economic base. ' utuau, 

. "-^^^ ^ concerned with -the 

qeo-raphic density of LEAs within the state. 

"gq^"--^ of Industrial ization of the State or LEAs: Was a 

thr?^ho^';;:;\'^''"^5^^^^^^i^"°" may p romote a dyn amism in 
the labor market and increase the need fo^ coordination in, 
planning vocational education. : ^tuxudcxon inj 

° Pl^"^inq Capabilities of State Divisions of Vo cat-ion^i 
^aucation: Was concerned with the extent to which a 
formal attempt is made to rationally plan vocational 

!fv^?^'°?* /'^'^ ^ ^i"^^ ^here a?e varying 

levels of planning capabilities acrpss states, and 
differences may give rise to different kinds of barriers 
axid facilitators to coordination. " «airirxers ^ 
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" Hniphasis on Bval u.it ion; The evaluation function is 

anteqral to effecti\7o planning in vocational education. 
It was necessary to represent different levels of emphasis 
* given to coordination in doing evaluation activities. 

/r list of candidate states were prioritized using the six • 
criteria, and th«- following states were selected as field site 
states: Florida, Wisconsin, Colorado, Oklahoma, Kansas, Texa.^, - 
Hoorqia, and West Virginia. - . 

Kach of the oiqht state divisions of vocational selected a staff 
person to coordinate project activities within the state. 

Obtaining Pertinent Information 

Two mutually supportive strategies were used to collect • ' 
information about coordination in planning vocational education. 
These were document reviews and guided dialogues. ' . . 

Prior to conducting dialogues in the states a variety of " 
pertinent documents were collected from each state. The 
selection of these documents' was. base'^ on the relevanqe of their 
content for several purposes including the following: / 

o Gaining familarity with the vocational education" System in. 
each state in order to understand the context for • 
coordination ' . • 

o Developing acquaintance with the governance structures for 
vocational education in each, state . 



> 



^ • o Acquiring specific examples of facilitdtive rjiechanismsv to 
coordination or examples which indicate successful oi: * • 
unsuccessful attempts toVcoordina'te and • 

o Identifying potential avenues for acquiring futher 

information ^ - ^ • : 

A sample list' of documents from- two states appears iw Appendix 

The review, of these documents, in addLtion to providing 
valuable information in preparation for the- interviews, 
functioned as a' preassessmen t of planning and coordination in 
each state. As a ^*»sult, each interviewer 'went irtto the dialogue 
situation wit-h an informed awareness of vocational educa-tion 
operations and concerns in the- respect ive state. ' ' 



' Immedtately. aft-r receiving documents from the states- " thA 

doquments were cataloged, filed and prepared for" data 

. abstraction. Prepar'ation for data 'abstraction required the 
sr/lt^^T^r""' '^^^^r^i^g ^^^^t- recording abs?rac?ed dSta. 

!i?n^^?K; ^e^oj^i^g sheets were developed ahd instructions for 
of 2Lh ^^'^^ prepared. 'The title aAd ?ocut 

of eaqh recording sheet aire listed in table 1. ^ocus 

' •< . ^ ' 

< fo'^ the di,alogues required several preparatory 

activities. -..These activities' included: (a) the selection of 
.interviewers and intervje^w^^^f b ) reviewing niater!3!rin • 
preparation for the dira-Togues; and, (c) preparing a topical ' 
outline to guide dialogue discussion. ThesJ are brieflj " 
-discussed in. the ifollowing paragraph." . , 

specific criteria supplied by the "project for guidance, ^ 
.leld.site^coctdinators selected, a variety of pers6ns to be 
interviewed. At the state level there we^e th?ee kinds of 
'indf::!^"^^--'? represented. /The first group inclSdJd ^ 
lit^ inZ^ "'^''^ knowledgeable about, or who were working- 

^;d^.iSu:Iri;°luSedr^"'^" to .make planning decisions. Thes^ 

o Individuals who were^^responsible for the preparation of • 

the state's vocational education plan, or individua-ls who ' 
• ^^s^^J""' the..,,eparation of sta.te voaationaT 

Individuals whose- assignments bridged the gap 'between ^ 
state and- local agencies in'the area of planning and 

relativrto ^^1.^ -Responsible for obtaining 'information 
relative to state plan preparation ■ , .. ' 
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r^5v-^5 °^ individuals /were those-funct/iohing outs'ide 

the- state department of vocational eduction who" represented 
?ocat?on.1 ^'f'^ -level, that are imme^diateiy- conceraed llth 
vocational .education operations ., These ind ividiials " ihcladfed - 
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Representatives- of the ,^tate advisory -councir for ' ' ^ 
-vocational education - (SACVE) ' . - - 

Members pf the state p^an group ^and ■'- > ■ • - 

• ! - ^ ^ ■ . ^ , 

RepceseWtatives of the state board of education; ■ 

^o??'!S!'^''^^^r^ state ^agency f or . commun i ty 

cpll^ges; and, representatives .of regional education- 
human resource training, groups ( e . g .■ ,. CETA) ; and the'state 
employment services off-ice - - ' state 



TABLE i 



RECORDING .SHEETS. 



Focus. of Recording Sheets 



I • '*Inf(ormation Recorded on 'Sheet 



Facilitators to Coordination. 



FACILITATORS TO , COORDINATION 1 Type ot Facilitation. 



I Functional areas- or activities ' 
^1 affected. ^ . ' — 



CONCERN FOR COORDINATION 



J -Descriptive phrase reflecting 
I concern. ' ' - ^ 

I Intended action to address concern. 

I Comments about concern e.g." 
I - source^ of -statement , persons 
I -involved . . ' ' ' ' . . 



I - Y 7-— — 

■ . I Planning or' coor'cJinatiori related' 

^ I barriers, -problems or * constraints 

PLANNING OR COORDINATION- ' | • . ^^^-"^"^^^ 

RELATED BARRIERS, PROBLEMS, 1 Type of- barrier, constraint or 
OR CONSTRAINTS j'oroblem. * 

• - , functional areas^activi ties 
_j ■ ' i I affected. ^- '^ 



I' 



Planning activities. 



_ PLANNING ACTIVITIES 



T 



PliANNING CONCERNS 



COORDINATION PATTERNS 
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/f Decision-focus of' planning 
I activity. ' ' 

1 . . " ^ - 

.1 Evidence. of coordination to. • 
accomplish data planning activity. 

I Planning • concern i ^ 
i ; " ' ^ . ^ . . ; 

J Decision-focus of each concern. 
I 

I Need for coordination to address 
I each concern ;. 

1 ~" ~~: — ^ ' ■ . — : — ^ — - 

I Coord ii:iati6p with whom, by whom. 

I - . ' 

I Comments on the,, purpose and na'ture 
I of coordination. ' • • 

I Classificatio.n of coordination icftko 
I categories; interuni^, - interagency 
I or between state and^local 
I agencies. ^ 



. • A' sxrfiilar set of criteria was used to select interviewees at 

•the local level. Application of the cri teri.a^ojr the selection 
of interviowefes- resulted in nearly 400 persons being selected by ' 
the field site coordinators in the" eight states. A breakdown of 
the . interviewee.*?, by position is found in table 2. 

The project team conducting the dialogues usually was 
comprised- of at le^st three persons: representative from the 
National Center assigned to the project^ the fiel,d site 
coordinator ^from a state -other than the one- in whiclj the* # 
-interviews were being conducted; and a consultant interviewer • - 
fsrom the -state in which the interviews were conducted. Each 
performed, a spe'cif ic function on the interview team. The project 
^*repr;esentative f rom^ th-e "Na t ional Center served as team leader and 
■'controlled" the" direction of the dialogue.' The field" site 

coordinators used' the experience acquired in their own states as. ' 
, a base for eliciting relevant information; while in-state ' . " " 

consul tant •interviewers joined the discus'&ion to clarify 
. responses and ask follovz-up questions 'basedTon their experiences 
in the state. . The consultant interviewers were persons who were 
famil-iar to the interviewees and their" presence contributed to a 
-relaxed atmosphe.re . in the interview situation. " However, before 
the data collection- strategies could actuaj.ly be.. implemented, 
extensive preparations were made. • v ' 

F6r each type of person interviewed Van outline of -topics for 
a. dialogue discussion was prepared. , The outline addressed 
anticipated responses .and potentia.l areas for probing, the 
outline was specifically 'for th.e use- of the interviewers and was 
tailored to fit the experiences of the interviewees and the ^ 
■ content bf the abstracted documents.- The topical outlines were~ - 
. developed from a re^Jiew of the documents - previously obtained from 
each state. The document reviews required ..reading documents to 

^■■^Qntify pp>rtinent i nformat inn, — rocording this information 

according, to prescribed gu-idelines, cross-checking the 
' ■ -categorizat.ion of information with other members of the -project 
■ st%ff to ensure commonalities of perspectives, and, filing the ' • 
. abstracted information by state 'name, and title of . the respect ive 
. recording forms. The abstracted information was used to prepare 
for the interviews and was then stored for later data synthesis 
purposes. ' . - . - . . 

. The'data collection via /dialogues- required the following five 
activitie.s:. predialogue briefings for interviews; postdialogu'e 
- discus<iions 'among interviewe^rs ; comparing information across 
dialogue sossipns in each state; comparing dialogue" information 
with data acquired 'from other sources; aind recording and 

^transcribing the dialogues. J 



TABLE 2 



PARTICIPANTS IN THE DIALOGUE S-ESSIONS ' * ? 



State Staf f--Vpcational Education J. ■ ' "Total 

State- Directors/Assistant" Directors/Section Directors ^ 25 

Program Area Supervisors/Consultants ; > • ' - • 38 

Planning/Budgeting/MIS ^Staf f . 29* 

Evaluation -^"taff ' . .. . - g - 

Disadvant.aged/Handicapped Specialists 7 

Equity Coord inastots/RCU/Affirmative Action 11 

Miscellaneous SDVE staff- o^r^^ 

State- Staf f-Reiated Departments — State Agencies ■ . 

Department of Public Instruction (nonvocational) - • • 6 

Boird of Regents/Postseccfidary Administrators ' 6. 

Department of Labor/Employmenr' Security "staf€, • ' . 4 ' ' 

Department of "Economic Development staff \- " 2 
State Occupational Information Coordir>ating Committee staff 8 

Miscellaneous p.' • ■ -j 



66 



Local Staff ... - •• - 

Local Vocational Education Darectors/Assistants 

Area Vocational Technical . School. Directors 23 
Comniunity College birectoirs/Deans/Presidents ' ' 45 

School Superintend^ents/Assistants " l 17 

Principals/Assistant Principals " 6 

Guidance Counselors ■ " -g 

€ETA/Skill Center- Administrators -. * 



Advisory Council/Iavolved Citizens 



State-^Advisory .Council for Vocationa-1 Education members 16 

Local Advisory' Councils for Vocational Education members 13 

School Board members . -j 

Misc'ell,aneous business and industry representatives -i 

State plan group members- , - ■ ' , a 

. .\ . . • ' • , . ■ 

other Groups 



Teacher Educators 



8 



ERIC 



8 - 



Analyzing and Synt hesizing Data 

• -— ^ . o ^' . . . ' , / . 

The^ interview-dialogues were- recorded by hand in two states 
and" on cas^sette tapes in six jstates. The recorded dialogues were 
later .Siftithe'SizeJ^! The end result' wa's^n abundance of data from 
the states '.pertaining .to 'barriers and facilitators to 
coordination in planning, vocational edQcation,- and data about a 
range o^ vocational education problems' and concerns. 

The data, transcripts were used to develop terse statements 
representing the coordination barriers and facilitators elicited/ 
and to summarize; the planning ac.t iv^i ties/ problems, and concerns 
that were, raised in th.^ .dialogues. This information .was placed 
into pertinent and explanatory categories for reporting purposes. 
In order to reflect the. appropriate content, however, these facts 
had to be accompanied by information th-at showed the Timi tat ions 
and excep-Ciqns Of the data. The dialogOje data were then combined 
with the data obtained from ^document 'reviews to more adequately 
reflect the barriers and facilitators to coordination in 
vocational education planning. 
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' s£CTIO^f i.i . 

GONQITIONS THAT AFFECT VOCATIONAL .EDQCATION PLANNING^ ' AND 
IMPROVING THE TECHNOLOGY .OF "VOCATIONAL EDUCATrON PLANNING: 

FINDINGS* AND PROCEDURES. 



Sumrnary of Findings 

The report about cont3itioris affecting vocational education, 
planning identif-ied the legislative and environmental contexts 
under .which vocational education takes place. The federal 
legi&lative framework for vocational education planning was . ^ 
described/ and key environmental context conditions, affecting 
-planning under • this framework were discussed. 

The conteixt conditions set the background for a discussion of 
five basTc issues* ia vocational education planning: , 

o. Preparation for specific available* jobs should/should not 
be the major basis for planning vocational education. 

o The federally mandated statie plan^ for vocational education 
^ does/does not serye as an adeguate* planning document fo^r 
state vocational edacatiqn agencies and local schools. 

,0 The mechanisms for coordination^ prescribed in the 
federal law: do/do jiot improve vocatijonal education 
planning. 

o A wide: range of demographic, economic / and employment data 
are/are not used in voccational education planning. - 

. o The federal thrusts for eyaXuatioA has/has not resulted in', 
evaluation information being" used in the planning prpcess*. 

Each of the five issues wis follow^, by a discussion. : The • 
discussion included key findings f.rom fieldwbrk. Then, correct 
issue i-mplicat ions for researqh or adminrlstration were discussed. 
The report concluded with an overview of the current; status of • 
vocational 'education planning. 

•The report about improving the technology of local -level 
vocational education planning identified the legislative and 
ehvironmenta'r contexts un^er which^ lopal vocational education 
planning takes place and noted corvtext conditions that affect^ 
such- planning. The context condijtions ser-ved: as a background for 
descriptions of the^c nature of interagency coord inative and 
collaborative -relationships in support .of planning., ways that 
data and evaluation are used in local planning, and local level 
planning arid processes The last section of the report listed a 
sample of suggeis ted techniques, and training ma£erials whose . ^ 
developii\ent -cou*Pd potentially improve the technology of local 

\ 10 . * : • ' 



vocational education planning and capac-itate the skills of 
persons who do this planning. 

* • • • 

. Overview of Erocedures 

In the preceding year's effort conclusions about, coordination 
in vocational education planning and about planning practices and 
issues^-were principally derived from opinions and judgments of a ' 
cross-section of persons involved with, or cpncerned about, the 
delivery of vocational education. This year it was decided that- 
in order .to verify, modify, or amplify, u'pon last year's 
•findings; ii; Vas necessary to develop -a different approach to* 
deriving findings about vocational education planning.. This year 
the approach focused on seeking evidence that could support the 
previous year's findings about vocational education planning. In 
this instance, evidence was to be es'tablished from planning' 
documeritaticn and from detailed and credible descriptions from • 
persons with vocational education planning, advisory, and 
supportive responsibilities. . «. ' 

•Identification bf^Key Issues and Areas" of Planning 

The specification of the domain of inquiry was thexfirst task 
that the project teaiii->.f aced . Basically, the aim of the study was 
to Identify and describe local-level practices for planning^and 
evaluation of vocational education programs, and to clarify key 
issues for- research and administration -that are oosed by analysis 
of. current practices. In essence, the study had' both a 
^descriptive. and a. normative thrust. The descriptive thrust 
embod.ied an observational analysis while the normative 'thrust 
required issue analysis. ; \ • _ ' 

The potential sc^e^ of the. study was thus ^ very^ broad : » . 
examination of plannijig processes, information utilization, and 
evaluation activities^. However, the 1979 findings seVved to 
narrow the kinds of o"bservat ions and issues that were ultimately 
selected for analysis. >. . ■ • 

■ ^ ^ - ■ > ' . , . '■ 

\^$fa^ the , previous 'year, the study team had identified six " 
functional areas of planning. These function/areas are ' 

enumerated -and described as: - , . . . . • 

° Resource .Allocation : The distributing ol resources among 
competing users v'.; - - ^ 

^ Resource Acquisition ; Obtaining resources to maintain ' 
-effective, system .operations -' 
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• -° Deterjnini ng Instruction P-rocrram Mix ; Determining the 
adequate mix of programs to meet the needs of clients* 
- withm the constraints of limited resources and 
legislative requirements. Operationally, this function 
addresses the process u^ed to.determine what programs will 
oe added • . • ». • 

' ' -i 

■ o Program Improvement and" Maintenance ; Procedures for 

modifying programs to maintain or improve • their adequacy 
and relevance . " . . ■ 

° In st^^uctional Supportive Servi^.^^. Determining -the 

nonmstructional services provided to students to enable * 
them to satisfactorily complete vocational programs and 
obtain employment (e.g., guidance, counseling, placement, 
tutorial services) ' ^ , • ' 

. ° System Maintenance a nd Support : Ensuring the satisfactory 
operation of the administrative, instructional, and 
physical environments. This function addresses the 
activities and considerations needed to ensure continued 
syltem^°" of. support for, the vocational education 

Because of resource and time constraints, the stuBy team did no^ ^ 
deem it advisable to fully investigate ail of the six lunctLnal 

-° d^li'nit the scope of investigation, ifwas ^ 
decided to place greatest emphasis on two • functional a^eas: X 
determining ms tr-uct ional program mix' and; program . improvement knd 
maintenance. Also, the study teem' dete mined that" the seTlction 
cf^^^S^K^ inquiry would depend ^to a certain extent on the - * 

?i=n s^^^^^'^dmg each inst'itution to be visited.- Rather ■ 

liTff.^ntT^'-''^ collect^a complete- set of . inf ormatiort on^ll 
SIX functions-or activities,-^ the team visiting any particular 
institution would focus on these planning operations in whic^ the 
administrator had been most^ acftive or recen?l« involved; For 
example, there would not be much sense in goWg over program mix 
Pla-nnmg at an ^institution that . had maintaLed^h^sa^e programs 

disdSI-ricfivT^Jr^^'^'^^r administrators to 

distfuss activities minimal or nonexistent at these institutions- 
would tend to introduce bias. - »uii.u.tions 

ol;,nn^n„"^^K^^^'''''°"^f^H topical areas of " 

planning to be researched. On the bdsis of the 1979- findings 
the study staff identified five different ^topic^l areas of ' . 

planning, for investi^tion. " The topical arefs Sere: planning « 

ofact?J.^''''-''r'^^'' information util iza tion ;. eva?ua?ion ' 

fnJ it^ '* ^"teragency coordination linkages and relationships^ 
and- planning for, special populations. ' - / ^J-^nsnips, ^ 
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An information-gathering approach was then developed for 
determining evidence about planning -processes and procedures 
actually used in the local areas visited. To accomplish this, 
staff_ reviewed summary findings from the 1979 effort, examined 
state and local planning documents, and read research -reports on 
vocational education planning and related areas. Appendix B 
lists a sample of documents secured from local schools. 

Then; procedures were designed for collecting observations 
about the five topical areas in the field site states. An 
important component of this design was ' the formulation of a 
procedure^ to collect data about each topical- area and then to 
integrate the observational requirements into one overall 
.approach. It was decided that an open-ended discussion format 
could be used to determine the planning operations of a local 
vocational education institution. Because of time constraints. 
It would be impractical to conduct five separate strands of 
mforniation gathering, in a local institution. The resulting 
process was designed to account for the type of staff (and their 
functiions) that would be encountered in vocational education - 
.institutions. This process was tested by having staff role-play 
various levels of vocational education staff and observing their 
reactions and responses to the open-ended discussion format. 
Through several iterations, the format was revised and brought to 
a final form. The -subsection on information collection describes 
the application and utilization of this technique in the field. 

Establishment of Logistical Arrangements ^ ' 

Four of the eight states participating in the study <if 
coordination in vocational education planning were invited and 
agreed to participate in the current study. These states were 
Florida, West Virginia, Wisconsin, and Oklahoma. - 

■ ■ . . 

^FOr the purposes of the study, local areas within each state 
needed to be selected for intensive visitation. These- local 
areas were'^chosen on-reconunendatioh of the respective state 
division staff according to certain criteria. The .'local area 
would- have to contain an appropriate mix of secondary and 
postsecondary institutions offering vocational education 
programs- It would encompass both urban and exurban geography.- 
The boundaries of . visitation would be constituted so that study 
staff would not have- to travel more, than a fifty-mile radius from 
the central city. The selection of area sites also took into 
account variations in economic stability- aiid industrial mix in 
order to pose varying environmental contexts. As a result four' 
primary regions of the country were chosen with the followina • 
characteristics: • . .. 
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hLf f ^ stable, primarily Anglo-Saxon pooulation 

oase, experiencing below average unemployment, dependent 
indSIirr^ processing, chemical, and mining 

o An area of dynamic population growth, with racial-ethnic 
characteristoLCs similar to the United States Average, 
experiencing, average unemployment with considerable 
indultrierwith''??^ increasingly pn tourism and service 
y agr?l.ultu?ar base.' '"""^ industry and a subs antial 

° ^h^fi^^ above-average population growth, with an ' 

a.bove-average population of Native Americans, experiencina 
• ^Sul'tfnS'ir^^-'^"^'"? ^ -long-term labor shirt^e ^ 
Sfo ^ exceptionally low unemployment rate, 

_ depending on petroleum extraction and related ind*usiries. 

° Kavfno^ ^^"^^^^ Slightly. declining population, ' 
having a broad mixture of racial and ethnic 

fSSo^^^"??^^''"' ^""P^^^^^oing high unemployment 
'-^^ ^Sn^^f 'f^^ ^"''''"^ n,inority youth), depending on heavy 
- fnanufacturing^irrdustries. i^cavy 

totarof'nin^^^^ four, regions comprising thirteen counties," a 
total of ninety-one persons were interviewed in thirtv-one 

^e-^y— ^^^^^ 

educational and noneaucational a^ncies in ealh o? the four 

With the- assistance of staff from the state divisions of 
vocational education in the four states, the proiec^ te2m 

-contacted administrators in school dist^ictS o^L! ^ 

institutions in each geographic aref^^'^Sjlcrstafr^erra?^^^ " 
permission to have discussions wit'h administrative and ^ " 
instructional staff at all levels of each institution 

-Appointments with key staff were arranged ^before fieJi 

^This was al<;o fhi J^^I "f^^^^t^^^ open, to be arranged- onsite. 



TA-BLE 3 

CATEGORIES OF PEPf^ONTS PARTICIPATING IN 
DIALOCrjE SESSIONS - 



CATEGORY 



Local Director and/or 
Assistant Directors 

Administrators of Postsecondary 
Vocational Institutions e.g. 
Presidents, Deans 

-..Superintendents 

Principals 

Teachers 

Local Vocational 
"Coordinators 

Placement Coordinator 

Administratorrs- - 
Student Services 

Administrators- ° 
Instructional Service's • 

Administrators- ^ 
Community Services 

Personnel in - ' . 
Research & Planning 

* Advisory Council 
- Members (State/Local) 

County Board of Education 
Members - . 



WI 



2 
2 
4 



STATE 

OK WV FL 
4 10 10 



1 

5 
2 



6 
2 
5 



•4 

« 

1 



2 



TOTAL 
30 
3 

-15 
10 
9 

5 
4^ 

5 

2 

2 



4 
10 
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TABLE" 3 (Continued) 

categorv 



STATE TOTAL 
WI OK WV FL 



Represent^ ^j_^es of Business 
and industry . 3 6 3 3 15 

CETA Directors 12 l 



Community gased Organizations lO 2 

I . . ■ ^ ■ - 

Empl6yT"^rit service 2 

Vocatio"^^! Rehabilitation l 1 



O . 16 
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14 26 
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officers^ or if those persons were unavailable, with the top 
administrators responsible for vocational education. These 
persons would be asked to describe the^ environmental context 
surrounding the institutipn, describe its vocational programs, 
and tall? aboat cheir perspectives about the planning and 
administrative issues and activities related to vocational 
education. Through this discussion^ study team members were 
introduced to the institution and were- able to identify salient 
planning activities that were occurring or had occurred in the 
recent past. « After the ir»tial discussion, team members were 
able to identify other district *or school staff who had 
significant roles in planning- or evaluating vocational education. 
The team attempted to visit suoh individuals, whose role and 
title varied considerably from institution to institution and 
from state to state.. For example, in one school district, most 
of the decisions were handled by the superintendent. In another 
district a vocational director and subordinates were delegated 
the respjg^sibility for vocational programs. In addition to 
middle-management; the team also held open-ended discussions with 
r teachers, whenever possible. 

In all discussions, the study team attempted to secure 
information to confirm and complement that which it had learned 
fromj, other persons. In most instances mbre than one study st^ff 
member participated in a dialogue. Written notes were kept by 
each member of r the team participating in a particular discussii^.n. 

In addition to discussions-, team members also observed 
•administrative behavior. They attended certain meetings where 
planning activities were taking place. For example, in one area, 
project staff attended a mee^ting of a regional vocational 
education planning council . On another occasion, a staff person 
attended (by invrtatibn) a state agency conference on developing 
interagency program linkages for human resource and vocational 
education: Observations of administrative behavior were 
complementec? by demonstrations of administrative concern. For 
example, if someone was commenting about the burden of paperwork 
required to fulfill legislative compliance, project staff woulS ' 
ask to see the forms and how and when they were to be completed- 

' " A third feature of the visitation was collection and review 
of appropriate local ^planning and evaluation documents. Review 
of those documents allowed subsequent discussions to be more 
focused and pointed. -By doing so, >the project team was also able 
in many cases to determine whether .^certain kinds of data were r 
important or unimportant In planning. . ^ • 



Information Analysis and Synthesis - 

• ' ir 

Upon their return from field visitation, staff edited their 
discussion notes. . 



This resulted in multiple sets of edited notes from each • 
institution visited and from the majority of persons contacted i 
each- institution. These. notes were subjected to a content 
analysis,, first by person; second by institution, and finally bv 
state to derive cumulative totals. _ . 

The content analysis was conducted by summarizing the notes 
and transferring findings to\a set of recording sheets. Staff 
developed recorci-ing/sheets for each of the five topical areas 
included m the investigation. The items listed on the recordin. 
sneets are designed to identify administrative practices, 4:he 
outcomes of these activities, problems or constraints, and other 
notes and comments. Appendix C presents a sample of the 
recording sheets for analysis conducted for the topical areas. 
At the individual institution level, appropriate categories were 
check-narked. Multiple responses were possible in all 
categories. Responses were ■ totaled for school districts and 
institutions m each state and for all schools and agencies in 
tne four states. - 

An exception to this procedure occurred in the analysis of 
-coordination patterns. To provide the most meaningful analysis 
-a complete set of recording sheets was compiled for each of a ' 
number of relationships. For example, for each vocational 

' --^ ^^^^^ "^^^ "^^^ record the relationship with 
other local vocational education institutions. Another sheet was 
ceta'^J^^''?^^^^^'''^ the vocational education relationship with 
. • sheets were used for vocational education " 

►and other agencies visited by the study team. An analysis was 
derived for each relati^ship, rather than the .sum totaf of a?l 
relationships." ^ i- 

o^H«'^^''!'' - -"^ member of the staff had compiled recor^<r>c sheets, 
other sta.-t persons who had visited' the same agencies rwiewld 
foTinw^^o'^o^'''' accuracy of classiMcat ion and completeness. Some 
.foJlow-up. phone calls'^ to ^schools W agencies visited in the 
field were made to clarify information items. 

^r-^^^l"^ t^l recording sheets had been completed for each topical 
area, it was then possible to summarize activities, outcomes; 
constraints, and benefits that resulted from planning and- 
evaluation activities in a sample of vocational- education * 
instituti-ons. Utilizing the completed recording sheets, staff 
member^ prepared >rief written summaries of the state-6f-the arf 
of each toi^ical areat-^ These summaries wer^ shared among staff 
for .r-eyiew and commentary. a »^ ly ^^'^^^ 

The 'findings of the study were assembled using the written 
summaries. . The^report,, The Technology of Voc^ational Ideation 
nonh^.-n^; f^^^^^^y s tra igh t forward expos i tiOn of material 
contained m the summaries.. The other report. Conditions 



■ Affecting Vocational Education Planning , required that staff *„ 
analyze, the findings- about coordination in vocational Education 
.planning, current vrocational education legislat^.on , and r€K:ent 
literature about -vocational education, planning in order to 
ident'ify a set' of currently salient vocational education planning 
issues. .Appendix f) lists a bibliography pertinent to the study. 
The discussion and implication sections of the issue analysis in 
Conditions Affecting- Vocational Education Planning depends, 
heavily on materinal summarized from recording sheets, -although 
not present>€f.d in so linear a fashion as in the other, more • 
descriptive report. : . . . 

' . ■ , . • •■• ' ■ ' 

' The findings that are contained in- this reports. Im provi ng the' 
Technoroqy of Vocation-al 'Education Planning and Conditions 
Af.fect'ing .Vocational Education Plannxnc^ ,. are presented with the 
realization that the findings ar.e influenced by at least twd 
factors: .- 

9 'A-re.as ;o£^ substantive focus and emphasis given to them were 
rnfluenced to an unknown extent by the findings of- the 
-previous year's study about ' coordination in vocational 
■ education plann,ing. ..." 

o The process of ^analyzing and syn.thesizing the extensive 
volume of documentation ^nd. dialogue commentary that was 
secured in the field required many subjective decisions 
about t!?eir credibility, and importance.. As a consequence," 
-the reported findings are subject to unintended errors in 
I judgment by . study team ihembers."' - * 
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I n forma t ion f r om 



''State Level" Documents 

1. %979^-80' Annual Program Plan of Colorado StSte Plan 

2. . 1978-79 Annual Program Plan of Colorado State Plan ^ - 

3. . 1978-82 Annual and Five- Year JState Plan 

4-. Accountabiiity'Report; Colorado State Plan 1978 
1976-77 Vocational Graduate Follow-up Analysis 

6. St%te Assistance for Vocational Education (Colorado law) 

7. { 2^r Personnel Listing, State Board for ..Com'munity Colleges 

8. Organization Chart, State Board 

9. (2) Inijight-Newsletter of' State Board ' - ' 



Local Documents — Postsecondary and Adult < * 

10 • (2) Operating and Approved Postsecondary Vocational Programs 

11. Colorado Postsecondary Data Collection System 

12. Colorado Postsecondary Data 5Collection System, Corrections/ 
Addition/Instructions * 

13^ VE-117 Adult Vocational Apprenticeship Program Data form 

14. VE --137 : Vocational ^Education Postsecondary Course JEnformation 

Local Documents — Secondary ' c 

15. I4idexed calendar* for LEA to submit planning forms 

16. Section on Vocational Education Planning from niew Local 
AdminisJ:rator Handbook (under revision) 

17. Form- VE-115 Long-Range Local Plan and instruction 

18. Form'^-120 (a) Institutional Application instructions 
and review criteria' \ 

19. Form VE-120 (b) Program Proposal Plan instructions and 
review criteria 

20. Form'VE-120 (g Proposal^ for Vocational Guidance or Job 
Development Specialist Progrcuns r ^ 

21. Form VE-135 Student Accountability Data Tool 

22. Form VE-116 Reqjjest for Supplemental Services Funds 
23* Form VE-101 Equipment-Materials Application ^ * 
2^. Form VE— 103 Request fojc Inventory Ad justment •of Property 
25^ Form yE-120 (h) Funds for Submitting Work Experience and 

Study Proposals • 
26t Form VE-123 -Additional Information Guideline for Submitting 
^ Proposals to Special Cooperative Programs 
27. Form VE-130 Vocational Staff Information 
28.. Form VE-159 Colorado Resident- Student Enrollment 



Colorado 



29» -Form VE-ieO Quarterly qjc Seaiester Report of ' Entitlement 
for Vocational Education 

30. ^ Form WS-1 Application to Parti^cipate in Work-Study -Program 

31. ' Form VE^312 Equipment Purchased for Vocational i^rograms 

32. Ftorm for Reimbursement of Contracted Programs 

3 3. "Form WS-2 Quarterly Report on Vocational Work-Study: Hours 

and Wages . ^ * . . " ^ . 

34. Local Plan School' District 50, Wes tmins'ter, Colorado 

35. Local Plan District 12, Thornton, -Adams County Colorado * 

36. Curriculum Gu«?Se, Boulder Valley Area Vocational Technical 
Center " ^ ^ ' ■ 

Advisory Council and Other Organizations Documents 

37. Agreement between State Department of Corrections and. 
Vocational Education 

38. 8t^ Annual Report, Colorado Advisory Council for Vocational, 
, Ediacation „ . • ^ ' 

39. Brochure: The Vocational Education Advisory 'Committee 

40. Memo from State Departme.nt to locals regarding advisory - 
councils ' ^ 

41. Colorado Commission for Vocational Education Pl'anning 
Minutes 3/29, 4/4, 4/13/77 ' ' 

Miscellaneous Materials ^ , 

42. (2) Denver Business (Chamber or Commerce) 

43. Seven Counties of Denver: Regional Busiriess Data 



- ■ - ■ . ■ ■ ■ ■ • • ■ . 

Information from Wisconsin 
* " ■» . . * * ■ 

"State Level" Documents , • ... 

A. Reports*, Position Papers " 
^ I. . 1978-1979 State Plan t ' 

2. Procedures Manual to. implement "Plan for ' Comprehensive 
VTAE to Wisconsin through 1980" 

3. Wisconsin Fiye-Year State Plan for VTAE 1978-1982 

4. 1979-1980 ^Plan^Highlights 

5. 1977-1978 Accountability Report > and 1979-1980 Annual 
Plan ' . 

" - - T -•■ ' ■ ) ' 

6. ^ Plan for Comprehensive VTAE to^Wisconsin through 1980 

7. ' Report to Governor. for Development of VTAE 1973-1977 

8. Cost Allocation Summary 1978t1979 (Projected) 

9. Cost Allocation Summary 1977-1978 (ActualT- . 

10. Financial Accounting ^ ' 

11. 19,75-1976 Statewide Student Follow-up Report 
12-. Report by RCU on Planning for Equity 

13. \1977-1979 Budget . 

14. Rep^t on Financing Local VTAE System . . . 

15. Wiscc^sin Administrative Code--Rules of VTAE 
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Draft Timetable — 19«0' Annual State Plan Development, 
Review, and Approval ~" ' ^ ^ 



17. Status of ^VTAE Administrator's Association Task Forces 

18. Report of Joint Adm. Comm. on Physical Facilities 

19. VTAE System Position Paper: .District Cost Control 
Appeals 



20. Assessment pf Vocational Education in Wisconsin. 1977, 
> by Advisory Council " ■ . • ' ■ ■ " 

21. Letter Crom State Director to U.S. Senator with Report 

22. Revi.ew. of VTAE Joint Adm. Comm. on Academic Programs 

23. -Report o-f VTAE Joint Adm. Comm. on Continuing Education 

■ ■' - ■* ' * , 

24. Facilities j;nventory and Utilization Report 1976-1977 

25. Environmental Impact Statement — Site Selection for • 
Skill/'Center • 

- • 26. Assessment of Vocational Education in Wisconsin 1976, 
by Advisory Council 

27. Paper titled: Planning, Research and Evaluation 

28. District Plan/Application Guidelines 

29. Calculation of FY 1979-80 Vocational- Education 
> Allocation ^ - 

* . .. 

30. P5ol icy Statements for Vpcational Education, in Wisconsin 

31. Merpo to District Directors on District" Budget Process 

32. Examples District Plan/Application 

•^B* Memos ' 

« • - ' c 

33. ,Memo from State' Director (6/8/79) — Program Developraeirt 
■ • . • • ■ ^ . • • "^^ --"^ • • 

34. Memo from State Director- — North Central VTAE District 
T&I Division Review, March 13-15, i7979 

■ . - , ■ / . • ■ " 

35. Memo from State Director — Workshop'^on r980-r981 VBA • 
District Plan/Application Preparation ' 

36. Memo on Goar Setting 

i - ■ - . ' . 

37. Memo from State Director to Affirmative Action Committee 
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Minutes . " ■ 

38. Winutes-UWS-VTAB' Joint Administrative Committee on 
Continuing Education ,• - 

39. Minutes: State Advisory Commil;tee 

, . Hospitality Management 

40. Minutes: State Data Processing Advisory 'Committee 



41. 

42. 
43. 
^4. 



-Minutes: State Distributive and Marketing Advisory 
Committee , ■ . ' ■ 

Minutes: ~ VTAE Administrator's Meeting 
District Administrators Meeting 
Minutes: Section 107 Meeting. 



D- Miscellaneous 

. 45. Map of VTAE Districts and Full-Time Campuses 
46. VTAE Personnel Directory 1978/1979 

1975 Wisconsin Agency Organization Chart 



47. 



48. VTAE Agency Organization Chart 4 - 

49. Report on NASDVE Conference on 'ssues and Implications 
for State- Planning . , 

"Local" Documents ^ - 

- ,\ . - . ■ . ■ 

50. Area VTAE District One Plan/Application 1980 
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.1. Community College — Management Information System 

2. Comrr College — Graduate Follow-Up 

.3. Vocai : *4<i^ Education Instructional Program Review 
Occupational Proficiency Programs 

4. Comprehensive* Education Plan X979-1980 

5. County School Board Meeting — October 18, 1977 — Minutes 

6. Coordina-ting Council: ^flinutes; Needs Assessment/ 
Recommendations 

7. Career Education Center: Information Brochure 

8. High School Class Schedule 

9. Local Education Agency Application for Federal Funds 



Handbook of Procedures for Implementing a Sex Equity 
Workshop 



11. Schools — newspaper ' . , 

*12. A Computer-Based Career Guidance and Counselor 

Administrative Support System: (Brochure) - \^ 

13. tMaster Plan of Instruct ion* for Nursery Operations 1979-1980 

14. Five-Year Comprehensive Vocational Education Plan lS^P-1982 
15., An Overview of Public .Education (Brochure) 

16. . Public Schools ^lan for Placement Services and Fo11ow-Ud 

Studies , ^ 

17. Follow-Up Survey of Former Students 

18. Occupational Proficiency Programs^ Final Class Report 
. 1979-1980 

19. Community Instructional Services Survey 




ERIC 



27 

35 



20 



21 

22, 
23. 

24. 

25. 

26. 

27. 

28. 

29. 

30. 

31. 

32. 

33. 
34. 



MemoranduTn from' State Department to Community Colleoe 
Presidents and District School Superintendents (regarding 
the availabUxty of funds to support the development of 
regional council vocational education plans) 

Folder of information- regarding education linkage 
developments • , . 

Program Planning for Vocational Education 

Requirements' for Entry into Auto Mechanics, Auto Body and 
Gasoline, Mechanics Course ^ ^ 

' . \ 

Put?iic Schools Assessment Report ^ . ^ 

Room Inventory Form ^ 
Master Plan - CETA 

Employment Survey Forms - . 

Student Survey Forms • 
Chamber. of Commerce Membership Directory 
Resource and Curriculum Guide 

r 

Newsletter 

Needs Assessment & Recommendations Vocational Education 
Planning , 

1979-1980 Report of the Superintendent of Schools ^ 
Placement & Fol low-Up Report 1977-1978 
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SAMPLE RECORDING FORMS 
FOR SUMMARIZING FIELD' SlTg 
EVIDENCE OF PLAISNING ACTIVITIES 



Pilto for Planning State: 
(Ptograjn Dcpansion, Deletion, etc.) 



Institution: 



Interviewee: 



. Planning Activity | Types of Data 




Oonments/Meods Expressed 



Ooordination State: 
Purpose of itelationship 



Institjition: 
Outccroes of ftelatioqship 



'Interviewt*: " 
Problems Cited/Observed iPacilitators C 



Ito. Ed. With: 

SCMS< 
Other V0d. 

Institutions 
fiiployment 

Service . 
CEIA 
CBO 

(ehabilitation 
Econanic 

Development 
idi^isoty 
'Qsuncil 
&qpIoyer 

Oamunity 
Other 



Range/Institutional 
I Planning 
nual Prograjn Planning 
ardinating Service 'to 
Particular Target 
I Groups 

baring Useful infor- 
nation/Giving Counsel 
xipliance with Le^is- •' 

I lative Mandates 
btaining Iblitical 

[Support 

Increasing Mutual 
[Awareness of Institu- 

tional Activities/ 

Capabilities 



Voc. Ed. Institution Utilizedl 
Data or Counsel Pron Other 
Institution in Long {tang^ 
Institutional Planning (or 
! Vice Versa) 

Ed. Institution Utilia 
I Data/ODunsel Fran the 
Institutions in Annual 
Program Planning Decisions 
(or Vice Versa) 



'f Protection/Oxpetitivc 
for Resources 
iPersonality Conflict 
[Organizational Policy/ 
Procedure 
[Legislation 
Lade of Awareness 
Other 



Voc* Ed. Institution obtainedl 
tota Fran other Institution iDescribe: 
for Inclusion in tteports 
Required by PederSl/State 
Government (or Vice Versa) 



:. Ed. Institution Shared 
Facilities, Equipment or 
Personnel with Other 
Institution (or Vice Versa) 



Ed. Institution Operate 
^ial Programs under 
Oontract to other 
Institutions (or Vice 
Versa) 

Jlationship Mimimal 
?r 

Jt Determined 
escribe: 



No Evidence 
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'lanning for Special Nteds 



State: 



Institution: 



Intervifwee: 



Purpose 



Evidence of Planning 



Outconies 



Qsnstrainti 



IMeetings H 
llocal Application ]n 
lother tocunents « \ 
[other 2J 

I * 1 

I * 1 


fepecial Ptograna ^ ] 
prollnent Qwnges 
policy/Procedures 
[changes ' 
bttitudinal Changes 
lother 


1 Lade Of Local Funds 
I- Lack of State F\ads 
1 Ooimunity Values. • 

1 Laclc of Student' Interest ^ 

1 School PersonneV Attitudes 
Other "[] 

1 k 

1 * 


■Not betemined 1 

1 1 


Did Not Detennine 1 


1 « 

1 * ' 1 

1 *^ 4 
Did Not Detennine 



Oaiments/Nc 



anning for 
ex Equity 



mning tor 

isadvanbged and I Meetings 
ndicapped 



Local Application 
Other Docunents 
Other . 



Special Programs 
[uirollnent Qianges 
Ucy/Procedure 
Changes' 

ttitudinal. Changes 



Lade of Local Funds 
Lack of State Fluds 
Oannunity Value 
Lack of Student Interest 
School Peirsonnel Attitudes 



. Evaluation for^ Planning ^ 



State: 



Institution: 



Source 


1 ' 

|Evidence of Evaluation Utilizations 


* . • ■ 

1 ■ Problens in Evaluation 


Sxtemal 

■ sew; Initiated 
: Assessments, 

' R^rts 
lACVE or Craft ~ 

■ Oarraittee ,' 
Other ' — 


■ 

iPEOcedures/Practices Document,.' 
|Evic3ence'0n Local ^^licaticn 
■Documentation that Evaluation 
1 Affected Jiecycling Decisions 
■Other Evidence 

B . . • • 


■ 

ji^ars to have little or no use 
1. locally 

■ other / — 

- 


Did Not Detennine, , 




1 " 


Internal . 






Student FbUow- 
• up 
Biployer -fbllow- 
up _ 
Staff Assesanents. 
of Program ' /j 
Relevance, ^ , 1 
Ouality • 1 
\ Other — 1 


Did Not Determine ' . ♦ 

Describe Evaluation Utilization ^ 1 

! * 1 

I 

» 1 

1 

■ 




3id Not Detezmne 
• 


c 1 

■ 

^ 1 

m 

1 
1 

■ 

■ 

■ 
■ 

' ' 1 


f . * 
* * 
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